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THE  NEGATIVE  BINOMIAL  DISTRIBUTION 


Part  1 


There  are  only  two  parameters  to  be  estimated  from  the  sample 
data  when  the  generalized  Negative  Binomial  frequency  function  is 
used  to  represent  the  population:  (1)  E(x}  and  (2)  0^^.  The  formula 
for  this  frequency  function  according  to  Hildebrand*  is: 

f{x)  =  .t.x  — ,.D  ^ l..r.  2... 


f{0) 


where  p  =  q 


1  and 


(T  ^ 

q  =  X  ,  k  =  fitxl .  ,  q  >  1,  k  >  0,  X  i  0,  E(x)  =  kp,  and 

E(x)  q  -  1 

=  kpq. 


A  useful  computing  formula  is  given  by  the  relationship  f(x)  = 
k  X  ~  .1  /  r\  f(x  -  1).  The  values  of  q  and  k  are  computed  from 

X  \q/ 

E(x)  and  Knowing  q  and  k  the  theoretical  probabilities  are 

generated  by  allowing  x  to  take  values  0,  1,  2,  . . .  Qo.  The  proba¬ 
bilities  should  then  be  compared  with  the  observed  frequencies  or 
histogram  by  using  the  y?"  test  or  the  k  -  s  test. 


*See  ALRAND  Rpt  19 


Part  II 


We  now  ask  ourselves  why  does  the  Negative  Binomial  frequency 
function  characterize  so  many  demand  analysis  problems  and  when  is 
it  safe  to  assume  the  demand  variable  is  distributed  according  to  this 
frequency  function.  In  cases  where  very  little  data  is  available  an 
assumption  regarding  the  type  of  frequency  function  is  often  necessary. 
One  reason  this  frequency  function  is  so  useful  is  its  great  flexibility 
due  to  the  two  parameters  in  the  formula.  It  is  not  a  single  formula 
but  a  two  family  set  of  curves.  However,  our  main  interest  is  the 
derivation  of  the  frequency  function.  This  should  suggest  why  and 
when  the  frequency  function  is  a  proper  mathematical  model  for  demand 
analysis.  The  ordinary  Poisson  frequency  function  is  expected  to  be 
useful  in  demand  analysis  because  in  its  derivation  the  main  assump¬ 
tion  is  that  the  values  of  the  variable  are  randomly  spaced  over  time. 
Then  the  frequency  function  of  the  variable  x(t)  or  demand  will  have 
an  ordinary  Poisson  frequency  function.  This  assumption  is  appar¬ 
ently  not  valid  for  a  large  variance  in  demand  due  to  clustering  where 
the  clusters  are  not  random  and  hence  the  demand  will  not  have  a 
Poisson  frequency  function  in  this  case. 

The  Negative  Binomial  or  Pascal  frequency  function  is  defined  by 
/r  +  k  -  1\ 

f(k;  r,  p)  =  ^  k  )  ’  k  =  0,  1,  2,  .  . .  .  It  equals  the 

probability  that  r  +  k  Bernoulli  trials  are  needed  to  produce  exactly  r 
successes.  The  probability  of  a  unit  demand  occurring  in  a  giv^n 
time  interval  is  denoted  by  p  where  p  +  q  =  1.  The  frequency 
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function,  f(k;  r,  p),  may  be  interpreted  as  the  probability  distribution 
for  the  waiting  time  to  the  r^^  "success.  "  This  frequency  fimction 
is  related  to  the  Poisson  frequency  function  in  the  following  manner: 


f(k;  r,  p) 


e 

k! 


if  q  -*>  0,  r  oo  >  and  rq 


A  remains 


fixed. 


The  frequency  function,  f(k,  r,  p),  is  called  Negative  Binomial 
due  to  the  following  relationship: 

f{k;r,  p)  =  ^)p'q^  =  ^  (k'^p'C-q)’^ 

k=0  k=0  k=0 


=  P 


CX»  /  . 

X  r  (r)i 


(-q)^  =  p*^{l-q)"*^  =  1  where  the  expemsion 


k=  0 


of  p^{l  -  q)"  ^  by  the  binomial  theorem  generates  the  probabilities 
f{k;  r,  p). 
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Part  m 


Let  n  be  a  random  variable  having  a  Poisson  frequency 
with  probabilities  ^  — —  ,  where  n  =  0,  1 . .  •  If 


be  a  random  variable  with  the  frequency  function 
the  probability  that  n  takes  amy  given  is  given  by: 


function 

we  let  jH 
1 

e 


Oo 


This  frequency  function  is  the  Negative  Binomial  frequency  function. 
This  derivation  of  the  Negative  Binomial  might  suggest  some  explana¬ 
tion  why  the  Negative  Binomial  is  more  useful  than  the  ordinary 
Poisson  for  certain  values  of  the  variance  in  demand  analysis.  It  has 
interesting  applications  to  accident  and  sickness  statistics. 
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Part  IV 


In  the  Negative  Binomial  distribution^ 


f(0)  =  where  p  =  q  -  1,  q  =  *^^/E(x), 


k  =  E(x)  ^  q  >  1,  k  >  0,  X  >  0,  E(x)  =  kp  and 

q  -  1 

-  k 

(T^  =  kpq  and  Mx(0)  =  Mx(6)  =  (q  -  pe®)  ,  let 
->  E(x)  or  q->l. 

Then  the  Negative  Binomial  distribution  approaches  the  Poisson  distri¬ 
bution  as  q^l. 

Proof:  The  moment  generating  function  for  the  Negative  Binomial 

-  k 

distribution  is  Mx(0)  =  (q  -  pe®)  .  Taking  the  logarithm  of  both 
members  of  this  equation  and  performing  some  calculations  we  have: 
log  Mx(0)  =  -k  log  (q  -  pe®) 

=  -  k  log  Ll  +  ~  P«®)] 

=  -  k  ((p  -  pe®)  -  l/2(p  -  pe®)^  +  l/3(p  -  pe®)^  -  . . .  .J 
=  (p(l  -  e®)  -  l/2p2(l  -  e®)^  +  l/3p^(l  -  e®)^- 

q  -  1 

=  -  a((1  -  e®)  -  l/2(q  -  1)(1  -  e®)2  +  l/3(q  -  1)^ 

•  (1  -  e®)3  - _ J 
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Letting  q ->  1  end  A  remain  fixed  we  have: 


log  Mx(0) 


/<(1  -  e^)  or  in  exponential  form  Mx(0) 


m(1  -  e®) 


But 


this  is  the  moment  generating  function  for  the  ordinary  Poisson  dis¬ 
tribution.  Therefore,  the  Negative  Binomial  distribution  approaches 
the  Poisson  distribution  as  q-»I.  This  theorem  has  important  impli¬ 
cations  in  demand  analysis  at  SPCC.  The  Poisson  distribution  is  a 
special  case  of  the  Negative  Binomial  distribution- -namely  when 
q-»l.  When  q  is  slightly  greater  than  or  equal  to  one,  we  do  not  gain 
anything  by  switching  to  the  Poisson  distribution  unless  the  computing 
becomes  simpler.  This  theorem  also  lends  support  to  the  suggestion 
that  the  demand  variable  (usage  rate)  is  usually  an  ordinary  Poisson 
variable  which  has  been  distorted  due  to  present  requisitioning  pro¬ 
cedures. 

By  reference  to  present  requisitioning  procedures  I  have  in  mind 
suggestions  made  by  CDR  Mills  and  others  regarding  the  effects  of 
order  sizes  and  ordering  habits.  Large  order  sizes  greatly  increase 
the  variance  and  have  no  effect  on  the  mean  of  the  demands  over  a 
long  time  period.  Another  interesting  requisitioning  habit  is  that 
apparently  people  prefer  to  order  in  even  numbered  units  rather  than 
odd  numbered  units.  This  strange  behavior,  if  true,  increases  the 
variance  of  the  demands  with  no  effect  on  the  mean. 

There  are  two  approaches  to  these  problems;  (1)  accept  the 
demand  rates  as  they  are  and  analyze  them  and  (2)  try  to  improve  the 
requisitioning  procedures.' 
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The  following  table  illustrates  the  relationship  between  the 


Poisson  distribution  and  the  Negative  Binomial  distribution. 

Negative  Binomial 


Poisson 


X 

f(x) 

X 

£(x) 

0 

.60653 

0 

.60835 

1 

.30327 

1 

.30113 

2 

.07582 

2 

. 07602 

3 

. 01264 

3 

. 01305 

4 

. 00158 

4 

.00171 

k  =  50.0 
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